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Abstract 


The field of machine— translat ion has matured a lot since the first generation systems 
which utilized the direct approach. The idea of memory based reasoning systems 
and example— based machine translation systems picked up in the late eighties. 
These systems, however, needed a very large example— base and a very powerful 
search engine. The HEBMT optimizes on the size of the example base by using a 
filtered and abstracted example base. The two bottlenecks in a HEBMT system 
are the dictionary search and the minimum distance calculation procedures. These 
algorithms implemented in hardwar<“ can significantly speed up machine translation. 

In this work, we have proposed a massively parallel architecture for HEBMT 
and designed two ASICs - DiSc for dictionary search and MiDiCal for minimum 
distance calculation . The DiSc performs binary search on the dictionary words 
to find the exact word. It tries to detect a mismatch between different words in 
a single comparison. It also uses a pre comparison criteria to decide whether at 
all to compare two words. The calculates the distance between the input 

sentence and all sentences in the partition. Internally, it uses 4 adders, 4 dividers 
and 4 multipliers in parallel. It finds out the sentence in the example base w’hich 
is closest in meaning to the input sentence. The DiS( processor and the MiDiCal 
were modeled at the behavioral level in VHDL and \'erilog respectively. The models 
were tested using a test bench circuit. 
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Chapter 1 


INTRODUCTION 


1.1 General Introduction 

The problem of machine translation has intrigued linguists and computer scientists 
alike for quite some time now. Decades of research have gone in trying to find a 
solution to this problem and we are not even close to solving it. The reasons for 
it are manifold. To solve a problem fully one must first be able to comprehend it. 
The problem of machine translation is not e^en fully understood. Comprehending 
the problem would require a detailed knowledge of fields as diverse as linguistics, 
computer science, mathematics, logic, biology, information theory etc.. This list is 
by no means complete as new perspectives add to it. The basic question that needs to 
be answered is — “ How do two people communicate ?”. Is language the only means 
of communication ? Does spoken language have some absolute, fixed meaning or is 
it just a vehicle for conveying the meaning of some higher understanding between 
the two entities ? As far as human beings are concerned, sometimes a mere wink of 
the eye says much more than words can ever express. The term machine translation 
sounds like a contradiction in itself. How can a dumb, emotionless machine translate 
natural language ? Well, that would have been the end of the story had it not 
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been for the utility of machine translation. The WWW(World Wide Web) has 
succeeded in stringing together the scientific community of the earth. However, 
there is nothing it can do about the language barrier. How convenient it would be 
for an American scientist to understand the results published in a Japanese journal 
if he had a Japanese to English translator engine with him! While human androids 
may still exist in the realm of science fiction, document processing is something 
very much in the state— of— art. Scientists have achieved a fair amount of success in 
solving subsets of the problem of machine translation. The approaches have varied 
and matured from time to time. 

A feature that most of these grand challenge problems share is that they re- 
quire tremendous computing power. Most of the current implementations run 
on massively parallel processors. Though the computing world in general seems 
to be moving away from mainframes to desktops, this is one area where these 
large machines will be useful for a long time to come. Each one of these grand 
challenge problems has its owm unique requirements. In general it is not possible 
to build a generic massively parallel system which can handle the idiosyncrasies of 
each problem. Building such massively parallel systems is an art in itself. When 
these systems run real time applications, fault tolerance becomes a crucial issue. 
Fault tolerance is just one of the many issues that must be kept in mind while 
designing these systems. In order to notch up the speed of these systems most of 
the functionality is committed to hardware. This is typically done by implementing 
critical functions in ASICs (Application Specific Integrated Circuits). 

ASIC design has matured a lot now. It is no longer considered to be so arcane, 
though it still is an art. This has been possible because of the rapid developments in 
the field of EDA (Electronic Design Automation) tools. The state— of— art of these 
tools is still not good enough to match custom designs. However, the ASIC design 
cycle has been greatly simplified. Design cycle times have been greatly reduced. 



o 


With this the time to market and tlie cost to market have also come down. ASICs 
are being used increasingly in custom solutions. In this thesis we have chosen NLP 
(Natural Language Processing) as the problem. We have identified some functions 
of the system which if implemented in hardware can significantly speed up machine 
translation. We have tried to provide ASIC solutions to these functions. 

1.2 Literature Survey 

The first generation machine translation systems utilized a naive, direct approach. 
The second generation systems used a rule based transfer approach [14]. A new gen- 
eration began when the emphasis shifted from linguistic considerations to exploiting 
language based on corpus, statistics, and examples [10]. Example based— approach 
was first proposed by analogy by Nagao[ll]. The same idea was then presented as 
memory— based reasoning by Stanfill and Waltz [15], and case— based reasoning by 
Reisbech and Schank[12]. Sumita and lida proposed an EBMT (Example Based 
Machine Translation) system. Sato and NagawD [13], highlight on the problem of 
utilizing more than one example for translating more than one sentence. 

Kitano [5], has presented an architecture for MBMT (memory— based machine 
translation) system. In MBMT system, translation is attempted from the raw 
examples by invoking the best suited example using a distance measure. Kitano et. 
al. [5], implemented an EBMT system on an IXM— 2 massively parallel associative 
memory processor and a CM— 2 Connection Machine. Lewis Tucker surveys some 
massively parallel architectures in [8]. 

1.3 Aim of the Thesis 

Kitano et. al.[5], have proposed the use of massively parallel processors for solving a 
number of grand challenge problems like EBMT and chess. Brute force algorithms 
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can never h<‘ a substitute for good algorithms. On tlie flip side of the coin, brute 
force coupled with good algorithms can surely work wonders. The state— of— art in 
algorithms and technology advocates the use of massively parallel architectures to 
solve complex problems. 

The aim of this thesis is to propose a massively parallel implementation of the 
HEBMT ( Hybrid Example Based Machine Translation ) architecture and model two 
ASICs which can be used in the proposed architecture. The first of the ASICs is a 
dictionary search processor, an important step in any machine translation system. 
The second ASIC is used to find the example which lias the minimum distance from 
the source language input sentence. 

1.4 Layout of the Thesis 

The thesis report is arranged as follows 

1 . Chapter 2 discusses the design of a hypothetical massively parallel architecture 

2. Chapter 3 discusses the design of the DiSt processor 

3. Chapter 4 lists the simulation results of the DiSe processor 

4. Chapter 5 discusses the design and simulation results of the MiDi processor 

5. Appendix A contains the component definitions of the DiSe processor in VHDL 

6. Appendix B contains the component definitions of the MiDi processor in 
VHDL 



Chapter 2 


DESIGN OF A MASSIVELY 
PARALLEL ARCHITECTURE 
FOR MACHINE TRANSLATION 

2.1 Introduction 

In this thesis we present the design of a Massively Parallel Architecture for Ma- 
chine Translation using the hybrid example based approach for machine translation 
(HEBMT) by Jain et. al.[l]- The HEBMT approach integrates the strategies of a 
rule/pattern based approach and the example based approach. The main problem 
with any example— based system is the efficient processing of a large example base 
which requires a large “memory” and tremendous processing power, beyond the 
capacity of ordinary sequential computers. These systems, however, lend themselves 
to tremendous data parallelism. Therefore we have selected this approach for 
designing the parallel architecture. 

The functional diagram of HEBMT is shown in Figure 2.1. The bsisic approach 
to HEBMT can be summarized as follows ; “ Given an input source language (SL) 
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sentence , find an example, from the example base, closest in meaning to the input 
sentence and perform some word level transformations to get the translation.” 



Figure 2.1: Block diagram of a HEBMT system 


The example base assumes gigantic proportions for large practical systems. The 
HEBMT optimizes on space by storing abstracted examples rather than raw exam- 
ples. Raw examples are the complete sentences in natural language. An abstracted 
example is collection of synt actic units, where each syntact ic unit is a group of words 
or a single word, such that there is a tight binding between the words of a syntactic 
unit. Translation time largely depends on the size of the example base, hence both 
the space required to store example base and the time for finding the best match, are 
reduced in HEBMT. By devising suitable data structures and efficiently partitioning 
the dictionary and example base, the search can be carried out in parallel by a large 
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number of processors, reducing processing time. In the thesis we have also discussed 
such partitioning schemes. 

In order to facilitate speedy translation, the process is divided into three phases 

1. Phase— 0 involves splitting the input sentence into simple sentences and iden- 
tification of the root verb. 

2. Phase— 1 involves morphological analysis and identification of the syntactic 
group of the sentence. 

3. In phase— 2 the distance of the input sentence from every other example stored 
in a partition of the example base is calculated. The example with minimum 
distance is the translation. 

The basic operation in morphological analysis is the dictionary search, which 
can be carried out in parallel. There are basically two ways in which the search can 
proceed viz. : 

1. Simple -search and 

2. Expectation— driven approach 

2.2 The Simple— Search Approach 

In this approach the morphological analysis and the syntactic category identification 
are carried out sequentially in that order. The search procedure handles only the 
morphological analysis. The yield is then fed to a finite— state machine which 
identifies the syntactic group of a sentence. 

The data— dictionary is organized w'ith the w'ords serving as keys. The words 
are arranged in the same format as one would find in the Oxford dictionary. Even 
in the simple search approach the search can be performed either for one word at a 
time or for several words in a sentence at the same time. 
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2.2.1 One Word at a Time 

When an input sentence arrives the first word is searched for in the dictionary. After 
a successful search the second word is searched and so on for all the words in the 
sentence. At any time, only one word is being searched in the dictionary. The 
advantage of this method is that it is very simple and straightforward. 

2.2.2 Several Words at the Same Time 

In this method, the search for several words in the input sentence proceeds at the 
same time, in parallel. If the size of the partition in which a word is to be searched is 
large then a greater number of processors can be assigned to look for the word. This 
approach leads to better throughput than the previous approach in terms of the 
number of successful searches per unit time. However, it is also more complicated. 
The scheduler must decide on the number of processors to allocate for each word. 
Other issues like uniform load balancing are also important. 

2.3 Expectation Driven Approach 

In this approach both the morphological analysis phase as well as the syntactic group 
identification phase have been integrated. In fact the morphological analysis or 
dictionary search is driven by the syntactic group identification analysis henceforth 
referred to as ISG. The motivation behind this approach is to simulate the working 
of the human brain, in a similar scenario. 

The first implication of this approach is reflected in the organization of the 
data— dictionary. The words no longer serve as the keys. At a very broad level the 
disk is partitioned on the basis of the syntactic categories of the words. For example 
all nouns go in one partition , all pronouns in another partition and so on. A second 
level index based on the alphabets in the word is used to reduce the search space. 
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The ISG is a finite state machine which captures the syntactic group of a 
sentence. A part of the ISG is shown in Figure 2.2. An example will make things 
more clear. Let the input sentence be ; 

“MARY HAD A LITTLE LAMB 



F'igure 2.2: Syntactic group identifier 


In state sO the ISG is expecting a NOUN, VERB or an ARTICLE denoted by 
the three transitions. Therefore the current expectations are for a NOUN, VERB 
or an ARTICLE. So the search procedure is directed to look for the word “MARY” 
in the partitions reserved for NOUN, VERB and ARTICLE. The processor which 
detects the word answers to the ISG in the affirmative. Note that it is possible for 
a word to belong to more than one syntactic grouj? in which case more than one 
processor w'ill answer in the affirmative. In such cases there cannot be a unique 
transition. The ISG can have more than one current state now’. All transitions out 
of the current states will become the current expectations. The search procedure is 
informed of the current expectations by the ISG and the second word is dispatched. 
Depending on the results new expectations are generated and some older ones are 
eliminated. This process is repeated for all words in the input sentence. Ultimately, 
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after all the words in a sentence have been processed the ISG will have traced a 
unique path from its initial state to some final state. In the process, it identifies the 
syntactic group of the input sentence, which in this case happens to be “< np > 
< vp > < np >”, where np stands for noun phrase and vp stands for verb phreise. 

The above technique can be improved by avoiding the traversal of unnecessary 
transitions. This technique simply uses a lookahead of one. Consider the same input 
sentence as above. The words “MARY” and “HAD” along with their expectations 
are pas.sed on to the search procedure. The search proceeds exactly as described 
above. Once the syntactic category of the second word is known, in most cases, it 
will help to eliminate .some unnecessary transitions. This approach can be carried 
on further but may complicate the scheduler which allocates search processors to 
words. 

The expectation driven approach is expected to be faster than the simple search 
approach. The reason for this optimism is that the search space is reduced in the 
former case. For example, the search space for an input word “wince” will be the 
set of all verbs beginning with ‘w’ in the expectation— driven approach as against 
the set of all words beginning with ’w’ in the simple— search approach. Obviously 
the search space is smaller in the first approach. 

2.4 The Parallel Architecture 

The proposed parallel architecture is shown in Figure 2. .3. The host is a front end 
computer which accepts source language sentences from the outside world. These 
sentences after some processing are dispatched to the phase- 1 master controller. 
The master— controller connects to a cluster of simple processors (SPs) through 
a common bus. The operations are pipelined in three stages where each stage 
corresponds to each phase of the HEBMT. 
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Figure 2.3; Overall system architecture 


In Figure 2.4 the SPs have a local/shared 4k RAM. Each local RAM is shared 
by an SP and the master— controller. The master— controller loads data from the 
disk into the local R AM of each SP and fires' the search procedure. All disk traffic 
is routed through the common high bandwidth bus. Each SP accesses only its local 
memory. The main advantage of this method is its simplicity. 

An improvement over the above architecture is shown in Figure 2.5 where each 
SP has a local/private cache in addition to a local/shared RAM. The memories are 
“active” memories(Asthana et. al.[3]). This enables the SPs to schedule their own 
disk operations through dedicated channels. Thus most of the disk traffic is kept off 
the common bus. This leads to lesser communication contention on the common bus 
as compared to the organization described in the previous paragraph. Since each 
SP accesses only its local/private cache and local/shared RAM there is no memory 
contention. All the clusters have access to a single multi— port disk. Alternatively 
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Figure 2 . 4 : Phase- 1 system architecture 


there could be many disk volumes serving groups of clusters. Data is replicated in 
different disks for fault— tolerance. 

It is worth mentioning that cache coherence is not a problem here. This is 
because no two simple processors operate on the same data at the same time and 
no two caches have a copy of the same data at the same time. Thus the overheads 
involved in maintaining cache coherence, bus— snooping, invalidate— on— write, etc., 
are eliminated. Each SP has access only to its local cache and a R AM which it shares 
with the master controller. The sharing takes place on a strict master slave basis 
so memory contention is eliminated. However some other fault— tolerance issues 
are involved. What happens if an SP fails? All the data in its cache/RAM will go 
unchecked. In the worst case the data being searched may be in the failed processor’s 
cache/RAM. A simple but expensive solution is to employ hardware redundancy 
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tcdiniques and use a backup processor for every SP. The master controller must 
have a way of detecting the failure of an SP and then transferring control to the 
backup processor. Alternatively the backup processor polls its primary SP and take 
over in the case of a failure. 

A significant performance gain is achieved by caching the results of searches. 
The caching can be done only at the master controller but the cache size will be 
large. Another approach is to use two level caching, one at the master controller 
and a second level at the SPs. The search procedure is a bit modified now. Given 
an input stream the dictionary search for the first few sentences proceeds just as 
outlined above except that the results of searches are simultaneously cached. For 
subsequent sentences most of the search requests can be satisfied from the cache 
itself. This is because only a small fraction of the words in a natural language have 
a high frequency of occurance. 

Disk 1/0 latency is further masked in the system shown in Figure 2.5 When an 
SP receives a word from the master controller it immediately begins the search in its 
cache while simultaneously scheduling a disk i/o. The master controller maintains 
a data structure SPMCT (SP memory content table) to keep track of data stored 
in the memory Mj of SPi- Before dispatching a word to an SP, it checks if any SP 
already has the disk block in its memory. The word to be searched can then be 
directly sent to that particular SP. This way a lot of unnecessary disk i/o can be 
eliminated. Similarly it is also possible to pre-fetch data thus overlapping search 
with i/o. Consider the scenario where the master controller has just dispatched a 
sentence Sn for processing to the SPs. Now, instead of waiting for the results of 5„ it 
can proceed and fetch the next input sentence, 5n+i- The words in 5n+i are passed 
through a filter which eliminates all those words whose information is already in the 
cache or memory. For those words which warrant a disk i/o , the master controller 
promptly issues a disk i/o request. A part of the RAM serves as a buffer pool. 
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Figure 2.5: Improved phase- 1 system arcliilectiire 


Thtis i/o for sentence 5„+i is overlapped with the search for Sn- Eventually when 
the processing of sentence 5„+i starts the data requests can be satisfied from the 
buffer pool itself. This is a simple memory to memory copy which is many orders 
of magnitude faster than a disk to memory copy. 

It may be pointed out that the basic hardware in both the cases, i.e, simple— search 
and expectation— driven appi'oaches, is the same. 

PHASE-2 

The host computer dispatches the sentence along with all the information gleaned 
in phase— 1 to the appropriate cluster in phase— 2. It consists of a series of disjoint 
clusters, each dedicated to a particular syntactic group. All the clusters are con- 
nected via a common bus to The host computer. Each cluster consists of many 
simple processors. Each SP has a local cache and RAM which is shared by the 
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controller of that cluster. .Having a single cluster for a syntactic group introduces 
a single point failure for all sentences belonging to that syntactic group. So for 
fault— tolerance reasons we let every syntactic group to be handled by two clusters. 
For example, the first cluster may handle all sentences of type “< np > < np > 

< vp >” and "*< np > < vp > < np > The second cluster may handle “< vp > 

< np >” and “< np > < vp > < np >'” and so on. 

There are certain design issues which are discussed next. Firstly the issue of 
uniform load- sharing among the clusters must be handled. The tradeoffs of having 
disjoint clusters as against a common pool of processors is to be considered. All 
The proce.ssors in this pool could work on a single sentence in parallel. Thus the 
stream of input sentences would have to be processed sequentially. However, the 
probability of two successive sentences, in an input stream, belonging to the same 
syntactic category is remote. Making use of this property it is possible to dispatch 
different sentences to different clusters. Thus we can have different clusters operating 
on different sentences at the same time. This partially ‘■‘solves” the problem of 
load— sharing. 

The example base is partitioned on the basis of the syntactic categories of 
sentences. All sentences of type “<np> <np> <vp>’’ go in one partition. In 
another partition we have sentences of type “<np> <np> <vp>” and so on. This 
helps in narrowing down the search space. A second level of partition is based on 
some other attributes of the sentence. We have physically separate disk volumes 
storing one or more partitions in a each disk. Data is also replicated on separate 
disks. This introduces multi-point failure. Each disk is dedicated to one or more 
clusters. This design , to an extent, mitigates the i/o bottlenecks as compared to 
the design where all the clusters access the same disk. 

A sentence, besides belonging to a particular syntactic category can have many 
attributes. In fact each phrase in a sentence is tagged with certain attributes like 
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NUMBER(singular, plural), PERSON(first, second, third), GENDER etc. Depending 
on the attributes some weights are attached to the phrases. The distance of an input 
sentence from every example in a partition of the example base is calculated. This 
is actually a phrase by phrase comparison of the attributes. The sentence with the 
minimum distance is returned as the translation. 

The main bottlenecks in the architecture described above are the dictionary 
search procedure and the distance calculation procedure. The following chapters 
discuss the design of two ASICs. Chapter 2 discusses the design of the DiSe processor 
which is a hardware implementation of the dictionary search algorithm. Chapter 4 
discusses the DiS( simulation results. Chapter 5 describes the design of the MiDiCal 
processor which is a hardware implementation of the distance matching algorithm. 
The simulation results are also discussed in the same chapter. 



Chapter 3 


THE DiSe PROCESSOR 


DiSe is an acronym for dictionary search. The DiSe processor searches a dictionary 
for the presence or absence of a particular input word. The “word” here means a 
word in a natural language. The DiSe is an ASIC which can be used in a machine 
translation sj'stem such as the one discussed in the previous chapter. 

This chapter contains a detailed description of the design of the DiSe processor 
as well as the factors which contributed to the evolution of the DiSe processor. 
The DiSe was modeled in VHDL ( Very High Speed Integrated Circuits Hardware 
Description Language). The DiSe was modeled at the behavioral level. A test-bench 
model, consisting of a memory-chip, a clock generator and the DiSe, was written 
in VHDL. The model was simulated with test ‘programs’ (actually data suites, 
as will become clear in the following pages). The DiSe is then broken down into 
its constituent components at the Register- Transfer level. All the components are 
documented in VHDL. A structural description of the DiSe using the components 
is then proposed. The outline of the chapter is as follows 

• Introduction. 

• Problem definition. 
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• How to solve it? 

• Instruction vs instructionless processor. 

• Disk data format. 

• Input Data format for the DiSe processor. 

• The DiSt processor interface. 

• Data and address bus protocols. 

• Behavioral description. 

• Description of the logic controller. 

• Register-transfer architecture. 

• Future directions. 

• Pseudo-code for the DiSe model. 

3.1 Introduction 

The working of a hybrid example based machine translation system was discussed 
in chapter 2. The main bottlenecks in the system are 

1. Dictionary searching process and 

2. The distance calculation process. 

The DiSe processor was designed to tackle the first bottleneck without any 
major intervention on the part of the master processor. The idea w'as to design a 
very simple, cost-effective, efficient processor which could do most of the dictionary 
searching work independently. So the DiSe doesn’t have any complex architectural 
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features like branch prediction, out of order execution ,etc.. The primary idea was 
to exploit the parallelism inherent in the application. It was intended that a large 
number of such processors could be used in a massively parallel environment so that 
the dictionary search process could be handled by a “package” of n such processors. 

Emerging technologies like WSI - wafer scale integration- and multi-chip modules 
would make it possible to pack hundreds of such chips on a single silicon wafer. Hav- 
ing a DiSi processor and its associated memory on the same chip would significantly 
speed up the DiSc. 

3.2 Problem Definition 

The problem for which the DiSt has been designed , is formally stated as follows ; 

“ Given a set of words W and an input word(string), IS, find out if IS is 
a mcinlx’r of the set W.” 


F(M^,/5) = 1 i/ JSe{W} 

= 0ifIS^{W} (3.1) 


IS 

{w} 



Yes 

No 


Figure 3.1: The DiSe concept 


where F is the characteristic function defined on set W. 
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The set W in equation 3.1 represents a dictionary and the string IS represents 
the word which is to be searched in the dictionary. The DiSe processor is a VLSI 
implementation of the characteristic function F. 

3.3 How to Solve It? 

The section departs from the precise but abstract problem definition of the previous 
section to more concrete implementation aspects. First of all we need an efficient 
algorithm to implement F. This brings us to the first and the most important decision 
regarding the DiSe processor : 

“ Should it be implemented as an instruction-set processor or an instructionless 
processor?” 

3.3.1 Instruction-set vs Instriictionless Processor 

There are some important factors which govern the choice of of an instruction-set 
processor as against an instruction-less processor. A very important factor which 
advocates the use of an instruction-set processor is flexibility. This is because 
an instruction set processor can be programmed. With a judicious choice/design 
of the instruction set, the processor can be programmed to handle a wide variety 
of input data formats. The input data string, IS, and the data dictionary can be 
in almost any format. However, flexibility doesn’t come for free. Implementation 
of an instruction-set through firmware, hardwired connections or nanoprogramming 
complicates chip design. It also occupies a lot of space on the silicon wafer which can 
be utilized for other purposes. Moreover the idea was not to build a complicated, 
generic processor but a simple ASIC. 

The alternative to an instruction set processor is to go in for an instructionless 
processor. The disadvantage is that it can be designed to accept only a few input 
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data formats. I'he more general we try to make it the more complicated it becomes. 
However, as will be pointed out shortly, the scenario is not really that bad. The 
biggest gain comes in terms of simplicity and speed. The logic is fairly simple. For 
a particular input data format, the instruction set processor has to 

1. Fetch the instruction. 

2. Decode the instruction. 

3. Fetch the data on which the instruction will act. 

4. Act on the data. 

5. Cleanup(reset W’rite-back flags, flush history buffers, etc^. 

On the other hand an instructionless processor has to 

1. Fetch (he data. 

2. Act on the data. 

3. Possibly cleanup. 

The instructionless processor has to perform two to three lesser operations as 
compared to an instruction-set processor. That is a lot of saving even if we consider 
the performance on translating the smallest of documents. Of course, by using some 
advanced architectural features it may be possible to mask the extra memory access 
latency of instruction set processors but it complicates the chip. Fortunately for our 
ai)plication the fixed input format is not a handicap. It is, in fact, our strongest 
motivation to go in for an instructionless processor. 

It is worth pointing out here what could have have been ideal implementation 
of the DiSe processor. Around the late 80s, a technology known as the WISC - 
Written Instruction Set Processor - had shown great promise. A WISC processor 
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has a programmable firmware control store in its core. So, for any input data format, 
it is possible to just change the firmware and “teach” the processor, so that it doesn’t 
spend time reading in the same instructions again and again. 

3.4 Disk Data Format 

The data- dictionary organization has already been discussed in section. In this 
section we focus on the format in which each word is stored on the disk. 

The data stored in a dictionary basically consists of words. Each word has 

1 . A meaning or meanings and 

2. Some other information such as whether it is a noun, a pronoun, a verb, 
masculine, feminine, singular, plural, etc.. 

WV club the meaning of tlie word and all other information about it into a single 
entity known as the attributes of the word. Therefore each record in the dictionary 
contains 

1. A word and 

2. The word’s attributes. 

The C language structure definition of a data- diet ionary record is as follows : 

struct dictionary .entry { 
string word; 
src_attributes attrib; 

}; 
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A dictionary has a structure. This means that that there are not many new words 
being added to the language or deleted from it very often nor do the meanings and 
attributes of words change frequently. 

The way each word and its attributes are stored on disk is shown in Figure 3.2. 
As can be seen from Figure 3.2 each word and its attributes are of different sizes. 
So there must be some way to know the starting and ending locations of each 
word. Similarly there must be some such delimiter for a word’s attributes. A simple 
delimiter is the length of each word and its attributes. We could also have used 
some particular bit string or special character for delimiting word boundaries but 
using lengths as delimiters has tremendous advantages which will become apparent 
when we discuss the behavioral modeling of the DiSe processor. Moreover choosing 
a special character which is special to all languages is difficult. Figure 3.2(d) shows 
the organization with word delimiters. 

The machine translation system architects are free to choose any organization 
for the attributes field. The overhead incurred in terms of space per word for the 
organization using word lengths as delimiters, is just two bytes per word-attribute 
pair(record). This organization is fairly generic in the sense that it offers the s/w 
writer total freedom in organizing the layout of attributes. Moreover the dictionary 
w'riter (data entry person) need not bother himself with the lengths of words and 
their attributes. A simple filter can do the job of calculating the lengths and inserting 
them into the dictionary records. There are no insertion deletion problems like 
internal fragmentation. 

It may be pointed out that this particular organization of data has no bearing 
on the overall organization of the dictionary. The dictionary can be partitioned on 
any basis w'hich facilitates speedy searching. It is only the leaf nodes in the search 
path which contain data in this format. 
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An attribute of word no. n 

1(W]) length of word no. 1 

1(A1) length of attribute of word no. 1 

Figure 3.2: Data dictionary record organization 


3.5 Input Data Format for the DiSe Processor 

The data loaded into main memory can be viewed as a string of bytes. The input 
string can be viewed as a pattern S. The overall problem is then simply matching 
the pattern S in the byte string and returning the attributes for a pattern match. 
This is a restricted form of the more general pattern matching problem in that we 
look for a pattern only at a word boundary. 

The main memory encapsulates all the data that have to be served as input to 
the DiSe. The input data includes 
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1. The pattern (word) to be searched and 

2. A list of records from the dictionary which are most likely to contain the input 
pattern (word). 

Figure 3.3 shows the main memory organization. This is the format in which 
data must be fed to the DiSe processor. 


Source Word Area 


Dictionary Area 


MEMORY 



no. 1 


Figure 3.3: Input data format 
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So far we have described the inputs and the format in which they are presented 
to the DiSe. Now we focus on the DiSe processor. 

3.6 The DiSe Processor Interface 



Figure 3.4: DiSe pin diagram 


The pin diagram of the DiSe processor is shown in Figure 3.4. It has 27 pins of 
which 

1. 12 pins interface to the memory address bus. 

2. 8 pins interface to the memory data bus. 


3. 2 pins interface to the clock generator. 
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4. 4 i)iiis arc for control. 

5. 1 pin for result. 

3.6.1 Clock Inputs 

Pins P30 (phil) and P29 (phi2) are the two clock inputs. Together, they provide a 
two phase non-overlapping clock for the DiSe processor. The clock waveforms are 
shown in Figure 3.5. Each cycle of the phil clock defines a bus_state, one of Ti 
(idle), Tl or T2. Bus transactions consist of a Tl state followed by one or more T2 
states, with Ti states betw'een transac tions. 



3.6.2 Address and Data Bus 

The DiSe processor communicates with its memory over synchronous 12-bit address 
and 8-bit data buses. Pins P2 to P13 form the address bus w'hile pins P21 to P28 
form the data bus. The port A_bus is a 12-bit address bus. The port D_bus is a 
8— bit bidirectional data bus. 
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3.6.3 Control Ports 

The Pins P14 and P15 are the read and ^ivrite ports. They control bus read and write 
transactions. Pin P19 stands for the ready port. This port is used by a memory 
device to indicate that a read data is available on the bus and or a write data has 
been accepted. Pin P20 is the reset port. This port is used by an external device 
such as the master processor to reset the DiSe processor. It is also known as the 
firing signal which sets off the DiSe to start its search procedure. 

3.6.4 Result Port 

This pin (P18) is used to announce the result of a search to an external entity. 
Actually it just interrupts the master processor saying that a search has ended. 
It does not indicate whether the search was successful or unsuccessful. The master 
processor has to verify the results in some other way which will be described shortly. 

3.7 Bus Protocol 

This section describes the DiSc-memoTy read and write protocols. The first sub- 
section deals with the memory read protocol and the second section deals with the 
memory write protocol. 

3.7.1 Read Protocol 

The timing for a bus read transaction is shown in Figure 3.6(a). During an idle 
state, Ti, the processor places the memory address on the address bus to start the 
transaction. The next state is the Tl state. After the leading edge of the phil 
clock, the processor asserts the read control signal, indicating that the address is 
valid and the memory should start the read transaction. It always leaves the write 
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signal negated during read transactions. During the Tl state and the following T2 
state, the memory accesses the requested data, and places it on the data bus. If it 
has completed the data access by the end of the T2 state, it asserts the ready signal. 
The processor accepts the data, and completes the transaction. On the other hand, 
if memory has not yet supplied data by the end of T2 state, it leaves ready false. 
The DiSc. then repeats T2 states until it detects ready true. In this way, a slow 
memory can extend the transaction until it has read the data. At the end of the 
transaction, the processor returns its control outputs to the default values, and the 
memory negates ready and removes the data from the data bus. The processor 
continues with idle states until the next transaction is required. 

3.7.2 Write Protocol 

The timing for a bus write transaction is shown in Figure 3.6(b). In this case also, 
the transaction starts with the DiSe placing the address on the address bus during 
a Ti state. After the leading edge of phil during the subsequent Tl state, the DiSt 
asserts the write signal. The read signal remains false for the whole transaction. 
During the Tl state, the processor also makes the data to be written available on 
the data bus. The memory can accept this data during the Tl and subsequent T2 
states. If it has completed the write by the end of the T2 state it asserts the ready 
signal. The processor then completes the transaction and continues with Ti states, 
and the memory removes the data from the data bus and negates ready. If the 
memory is not able to complete the write by the end of the T2 state, it leaves ready 
false. The processor will then repeat T2 states until it detects ready true. 



bus read trar saction. 


30 



Figure 3.6: DiSe bus protocol 
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3.8 Behavioral Model 

In this section a behavioral description of the DiSe processor is presented. This 
model is used to run test programs (actually data suites ) by connecting it to a 
simulated memory model. 

We begin the behavioral description with an entity declaration of the DiSe 
processor shown below : 

entity DiSe is 
generic ( 

Tpd : Time := unit_delay; 

TaC : Time := unit.delay; 

); 

port ( 

phil : in bit ; 
phi2 : in bit ; 

d_bus : inout bus_bit_8 BUS ; 

a_bus : out bit_12 ; 

reset : in bit ; 

ready : in bit ; 

read : out bit ; 

write : out bit ; 

result: out bit 

); 

end mux2; 

The entity has a generic constant, Tpd, used to specify the propagation delay 
between input events and output signal changes. The constant, TaC, specifies the 
access times of registers. The default value, unit delay, is specified in a DSP -types 
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Figure 3.7: DiSe port interface 


package. There are a number of ports corresponding to those shown in Figure 3.7. 
The reset, clocks (phil and phi2), bus control signals and result signal are repre- 
sented by values of type bit. The address bus output is a simple bit-vector type as 
the processor is the only module driving the bus. On the other hand the data bus is 
a resolved bit-vector type, as it may be driven by both the processor and a memory 
module. The w'ord bus in the port declaration indicates that all the drivers for the 
data bus may be disconnected at the same time (i.e, none of them is driving the 
bus). 

Figure 3.8 shows the state diagram of the DiSe processor. Throughout its 
operation the DiSe traverses through a maximum of 10 states. Each one of these 
states can be broken down into smaller states as one goes into finer/lower levels of 
modeling. In the following sections we explain the behavior of the DiSe processor 
in each one of the ten states. 




Figure 3.8; DiSc state transition diagram 


The VHDL model is implemented by a single concurrent statement, an anony- 
mous process which implements the behavior as a sequential algorithm. This pro- 
cess declares a number of variables which define the internal state of the processor. 

3.8.1 Declarations for the DiSe 

The declaration section for the architecture body contains declarations for 

• The program counter. 

• The general register file. 

• The source register file. 


• State variables to hold current and next state. 
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• Mux converters. 

• Condition code flags. 

• Other miscellaneous variables. 

The procedure memory .read, implements the behavioral model of a memory 
read transaction. The parameters are the memory address to read from and a result 
parameter returning the data read. The procedure refers to the entity ports, which 
are visible because they are declared in the parent of the procedure. 

The procedure memory .write, is similar, implementing the model for a memory 
write transaction. The parameters are the memory address to write to and the data 
to write. At the end of a transaction there is a null signal assignment to the data 
bus port. This models the behavior of the processor disconnecting from the data 
bus, i.e, it stops driving the data bus. 

There are some other procedures which are called by the process implementing 
the DiSe. They are declared in the DSP-types package. The procedure add models 
the behavior of an adder. It takes two parameters, op_l and op.2, which hold the 
two operands, a result parameter which holds the sum and an overflow parameter. 

The procedure compare models the behavior of a comparator. It takes two 
parameters, op.l and op.2, which hold the two values to be compared, and three 
flags, LT , EQ, GT which are set depending on whether op_l is less than, equal to 
or greater than op ..2. 

The procedure next_read models the behavior of accessing the source register 
file. It takes as parameters the source register file, the next register which is to be 
read, the temporary variable into which the data will be placed and a flag which is 
set when the next register to be read points beyond the last register. 

The procedure next.write models the behavior of writing into the source register 
file. It is similar to the nextjread procedure. In both these procedures the controller 
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doesn’t specify the address of the next procedure to be read or written. This 
information is maintained in the register file itself. This is possible since the source 
register file is always accessed sequentially, i.e the first register followed by the second 
register and so on. The count wraps around after reading the sixteenth register. 


3.9 Controller Process 

I'he body of the process which implements the controller is discussed next. This 
process is activated during the initialization phase of a simulation. 

When powered up, the DiSc processor checks for the reset signal active at the 
rising edge of ‘phil. When the reset input is asserted, all of the control ports are 
returned to their initial states, the data bus driver is disconnected, the program 
counter is cleared, the next register to be fetched from the source register file is set 
to ’O’, result is set to ’0’ and the current state is set to RESETTING. 

3.9.1 State : RESETTING 

In this state the model waits until reset is negated before proceeding further. The 
model checks for the reset signal going ’0’ at every falling edge of phi2. If reset goes 
to ’0’ then the current state changes to S.O. Throughout the duration of operation 
of the DiSe processor, the reset input is checked after each bus transaction. If the 
transaction was aborted by a reset being asserted, no further action is taken in 
fetching or manipulating data. The control falls through to the reset handling code. 

3.9.2 State ; S_0(Fetcli Input Word Length) 

In this state the program counter, PC, contents are latched onto the address bus. 
The PC contents at this stage are X“000”. As shown in Figure 3.3 memory location 
X“000” contains the length of the source(input) word, i.e the word w'hich is being 
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searched. The source word length is fetched and stored in the SRC.LENGTH register 
in the general register file. The source word length is 8-bits long and so is the 
register SRC_LENGTH. If in the meanwhile reset is asserted theh all operations are 
suspended and state changes to RESETTING. In the course of normal operation 
next state is changed to S-1. 

3.9.3 State : S_1 (Fetch the Input Word) 

In this state the DiSc processor fctclies a maximum of sixteen source word bytes 
from memory. Memory locations X“000” through X“100” are reserved for the source 
word. Each source word byte fetched from memory is stored in a register in the 
source register file. The source register file has sixteen registers. These are used to 
cache the source word bytes. The logic behind this is that when the source word 
bytes are compared with the words in the dictionary they need not be fetched from 
main memory every time they are compared. The DiSc uses the source register file 
to establish a sort of working set of source word bytes. It is expected that the first 
sixteen bytes of two words are enough to distinguish between them. 

The SRC-LENGTH register is used extensively in this phase. The DiSe processor 
compares the SRC.LENGTH register contents against the PC to determine the 
number of bytes already fetched. The comparison also ensures that the number of 
bytes fetched is just enough to fit into the source register file. 

The model changes state to SS w’hen it finishes fetching all the source bytes, in 
case the SRCXENGTH is less than or equal to sixteen. If the SRCJLENGTH is 
exactly sixteen bytes then a flag cc.L is set. The utility of this flag will become clear 
shortly. In case the SRC_LENGTH happens to be greater than sixteen the DiSe 
processor just fetches the first sixteen bytes to source register file and changes state 
to S-2. The PC at this stage contains the number of source word bytes fetched. 
This is an offset into the source word string. The PC value is stored into a register 
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sue -Of I' SET. The vahic X“101” is loaded into the PC before switching to state 
S-S. 

At the end of state S.l we have 

• SRC-LENGTH contains the source word length. 

• SRC_OFFSET contains the number of source bytes fetched. 

• The .source register file contains source word bytes. 

• PC i.s loaded with value X“101’’ and 

• Next state is S.2. 


3.9.4 State : S_2(Compare Word Lengths) 

The DiSc processor fetches the length of the current word being compared from 
the dictionary. I'his byte is stored in the register CUR-LENGTH. It compares the 
current word length, which happens to be one byte long, with the length of the 
source word which is stored in register SRCJLENGTH. If the two lengths are not 
equal then the words cannot be equal and therefore PC is adjusted to point to the 
beginning of the next word. If the two lengths are equal then it is possible that they 
may be identical and hence it is necessary to compare them. The CUR-LENGTH 
is added to the PC contents and the sum is stored in a temporary register TEMPI. 
The next state is set as SS. 

It is also possible that the word being searched doesn’t exist in memory. There 
must b<> some way for the DiSt to know that it has looked up all words in memory 
and it must not look further. This is accomplished by setting the word length in 
the last record to ’O’. In state S-2, when the DiSe finds a record with word length 
’0’ it moves to state FAILURE. 

At the end of state S_2 
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• Next state is FAILURE or 

• NEXT state is S_3 and 

• PC points to the beginning of a dictionary record 

• TEMPI contains PC + CUR.LENGTH 


3.9.5 State : S_3(Compare Words Bytewise) 

The DiSf fetches bytes from the record currently pointed to by PC. The PC is 
incremented after each menwry access. The contents of TEMPI are compared with 
PC after each memory access to see if tirere are any more bytes from the current 
record that need to be fetched. Each byte fetched from memory is compared with a 
byte from the source register file. A match entails another memory fetch. If all the 
current record bytes match all the source word bytes then the DiSc enters the state 
SUCCESS. 

If the source word and the current word are not equal then the first byte in which 
they do not match will cause the DiSe to return to the state S.£. However, before 
returning to S_2, the PC is adjusted to point to the next record in memory. 

In some rare cases it may happen that the source word and the current word 
match for the first sixteen bytes. Now the cache must refreshed with subsequent 
bytes (seventeenth byte onwards) from the source word. The PC contents are stored 
in register CUR-LENGTH. The contents of the register SRC-OFFSET are loaded 
onto PC. Now the PC points to the next source word byte which should be fetched. 
The state is then changed to 8-4- 

Sometimes it may happen that a mismatch occurs between a source byte and 
a current word byte after the source register file has been refreshed at least once. 
Then the DiSe processor changes state to S.5. 
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3.9.6 State : S_4(Refresh Cache With Next Page) 

In tins state the DiSe processor goes into loop to refresh the source register file. 
The PC points to the next byte to be fetched. Each source byte fetched is stored 
in the source register file. After each memory access the PC is compared with 
the SRC-LENGTH register to determine if another byte is to be fetdied. This 
loop continues until contents of PC equals contents of SRC-LENGTH or the source 
register file is full. Since this state was entered as a result of the successful match of 
all the bytes in the source register file the DiSc n>ust return to state S-3 to continue 
its operation of matching corresponding bytes. Before returning to S_3 the PC 
contents are dumped into the SRC.OFFSET register. The PC is loaded with the 
contents of CUR_LENGTH so that it once again points to the byte in the current 
word which must be fetched next. This is done to restore the state in S_3 at the 
point at which the processor entered S_4. 

The flag cc.L is set if the sixteenth byte in the source register file happens to be 
the last byte of the source word. The controller process checks this flag to determine 
if it must refrt^sh the source register file. 

3.9.7 State : S_5(Fill Cache With First Page) 

This state is entered when the source word and the current word differ after the 
source register file has been refreshed at least once. The current record has to 
changed as a result of the mismatch. Now it is not possible to match the first byte 
of tlu' current word witli that of the source word. This is because the source register 
fih' contains bytes numbered higher than sixteen as a result of the rcfresh(es). So 
the source register file must be reloaded with the first sixteen bytes of the source 
word. 

The operations in this state are identical to that of state S-1. The source register 
file is refreshed and then control is transferred to state SS. 
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3.9.8 State : SUCCESS 

This state is entered when the DiSe is successful in finding a matching word in the 
dictionary. The register ILMPl points to the base address of the current record 
at all times. The lower byte of TEMPI is written to the memory location X”000’’. 
The upper byte of TEMPI is written to memory address X”001”. The result signal 
is asserted to interrupt the master processor. The master processor then picks up 
the address of the matched word from the memory addresses X”000” and X’’001”, 
and goes to the idh state. 

3.9.9 State : FAILURE 

This state is reached when none of the words in the dictionary match the source 
word. The memory locations X”000'' and X^OOl" are filled with zeroes and the 
result signal is asserted. The zero code is an indication to the master jjrocessor that 
the search was unsucce.ssful. Th(“ next state is the idle state. 

3.9.10 State : IDLE 

This is an idle state for the machine. It goes into a loop checking for the reset signal 
at every leading edge ofphil. If reset is asserted it goes into state RESETTING. 

3.10 Register Transfer Architecture 

This section deals with the internal structure* of the DiSe processor. Such a de- 
scription is invaluable, as it provides the ASIC designer with a set of handles or 
tunable parameters. The designer can then play around with these parameters and 
analyze the performance to arrive at an optimal design. This is very convenient to 
have before committing expensive resources to detailed design and implementation. 
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Another cogent reason is that the state of the art tools are not mature enough to 
synthesize gate level net-lists directly from the behavioral description. 

Once a behavioral architecture has been decided upon, we carry out the design 
of the next level of architecture. Figure 3.9 shows a block diagram of a simple 
architecture to implement the DiSc processor. Such a hierarchical design simplifies 
the design process. The visible components are 

• A twelve bit carry lookahead adder 

• An eight bit comparator 

• A general register file 

• A source register file 

• A program counter 

• A control unit and 

• Latches and muxe.s 

The following subsections describe each of the components used in the proposed 
DiSe architecture. A VHDL entity description for each component is given in 
appendix A. 

3.10.1 Multiplexor (Ml and M2) 

The entity has a sekef input bit, an 8- bit wide input iO, a 12-bit wide input il and 
a bit-vector output y. 

The architecture body contains a VHDL concurrent select statement. It uses 
the value of the select input to determine w'hich of the two bit- vector inputs is passed 
through to the output. The assignment is sensitive to all the input signals, so when 
any of them changes, the assignment will be resumed. 
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Address-bus 


Figure 3.9; RTL architecture of the DiS( processor 
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3.10.2 IVaiisparent Latch(Ll, EQ, LT, GT) 

I’he entity has an enable input bit en, a bit-vector input d and a bit-vector output 
q. The size of the bit vector ports is determined by the generic constant width which 
must be specified when the entity is used in a structural description. The entity 
models the behavior of a D-latch. 

The architecture body contains a VHDL process statement sensitive to the d 
and en inputs. The behavior of the latch is such that when en is T’, changes on d 
are transmitted through to q. When en changes to ’O’, any new value on d is ignored 
an the current value on q is maintained. 


3.10.3 Buffer(Bl and B2) 

The entity has an enable input bit cn, a bit-vector input a and a resolved bit- vector 
output b. 

The behavior is implemented by a VHDL process statement sensitive to the en 
and a inputs. If en is ’1’ then the a input is transmitted through to the b output. 
If en is ’O’, the driver for b is disconnected and the value on a is ignored. 

3.10.4 Program Comiter{PC) 

It has a 12-bit-vector input port d.m, an output port d.out, a c/ear bit input port, 
a lafcluen and an oiiLen port. 

Internally, the PC is implemented as a master slave register pair. When clear is 
enabled the PC is filled with zeroes. When latch.en is ’1’ then the value on d.in is 
stored in the master register but the output (if enabled) is driven from the previously 
stored value of the slave register. With latch-en disabled the slave value is updated 
from the master value and any further changes in d are ignored. 
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3.10.5 General Register File 

It has two r<‘ad ports rp^l and with their corresponding address ports rad.l 
and rad.2. It has only one write port wp.gr with its corresponding address port aS. 
Each one of the read and write ports has an enable port associated with it. 

The bcliavior is implemented by a single VHDL process statement. When any 
of the inputs change, firstly the write port enable pin, cn5, is checked, and if asserted, 
ihv addressed register is updated. Then the read ports are checked. If asserted the 
adtlressed data is fetched and driven onto the corresponding data bus. If the port 
is disabh'd then the data output bus driver is disconnected. 

3.10.6 Source Register File 

It has just one read port RD with an enable port enl, a write port WR with enable 
port enS and three bit ports, next, mii and count.16. 

'I'he behavior is iinplemeiited as a single VHDL process. The init signal when 
as.serted, resets the internal state of the source register file. The next register to be 
accessed is set to the first register. For every next signal the internal register pointer 
is incremented. The signal count. 16 is asserted when the internal register pointer 
“falls off” after pointing to the last register. It actually wraps around to point to 
the first register. 

3.10.7 Arithmetic Unit (ALU) 

The two Ti-bit- vector ports op.l and op.2 hold the two operands. Result port holds 
the result of the arithmetic operation. The command port tells which function to 
perform while the enable port fires the operation. Port carry.in.O holds the carry 
into the zeroth bit for an add operation. 

The Arithmetic unit supports only two functions ; 
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1. Adds op.l and opJ2 when command is ‘1’ 

2. Simply passes op_l tlirough to result when command is ‘0’ 

The function is performed only when enable is asserted. The result bus is only 
driven if enable is asserted, otherwise it is disconnected. 

The adder is implemented as a carry-lookahead adder. Hamacher et. al., 1990, 
contains a detailed description of the carry-lookahead adder. This implementation 
was chosen mainly becau.s(‘ it its speed doesn’t suffer with scaling. This adder has 
a tlnwetical complexity of only 6 gate delays for producing the sum and carry-out 
from the most significant bit. However practical considerations like fan-in and fan- 
out prevent the processor from delivering the expected performance of 6 gate delays. 
So the implementation assumes a fan-in of 4. The 12-bit adder is then implemented 
using thre<' 4-bit carry- lookahead adders. Each one of the 4-bit adders takes 3 gate 
delays to produce all the carries. A further 2 gate delays are required to generate 
(1.12 by applying the carry lookahead technique over the carries produced by the 
4-bit units. After all the carries have been produced, 3 more gate delays are required 
to produce the sum. Thus the output is available 8 gate units after the inputs have 
been applied. 


3.10.8 Comparator Unit(COMP) 

The two 8-bit wide bit-vector ports op-1 and op-2 hold the two values to be com- 
pared. The bit ports EQ(equal), LT(less) and G7\greater) show the results of the 
comparison, and enable is used to fire the comparison. 

The architecture consists of a single VHDL process statement. Once enable is 
asserted, cp.l is compared with op-2. EQ is asserted if op-1 is equal to op_^, GTis 
asserted if op-1 is greater then op-2, and LT is asserted if op-1 is less than op-2. 
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A 12- bit comparator, assuming 4-input gates, requires 4 gate delays to produce 
the EQ output. The number of gates required is - 12 X.NOR gates and 3 AND 
gates. The delay required to produce the LT output is 6 gate delays. The number 
of gates required for the LT output is - 12 NOT gates, 12 XNOR gates, 3 OR gates, 
and 36 AND gates. The same is true also for the GT output. 

All tlu’se components can be connected in a structural VHDL model to yield a 
.structural description. 


3.11 Future Directions 

'I'he design of the DiSt processor presented above was modeled at the behavioral 
level. There are many intermediate levels of modeling before it can be delivered to 
the fabrication unit. However, detailed design can build on the framework provided 
by our behavioral rnodel. Here we suggest a couple of improvements that may 
appreciably improve the p<*rformance of the DiSc. 


3.11.1 An Effective Pre-comparison Criteria 

As shown in Figure 3.3, each word in the dictionary is prefixed with its length. 
Besides acting as a record delimiter it also serves another purpose. The DiSe 
compares this length with the source word length. If the two lengths are equal 
then words need to be compared. A better method would be to reserve a byte next 
to the length field. An effective hash function can be used to calculate a unique 
seed value for each word which is then stored in the reserved byte. This would 
significantly speed up the comparison process as the DiSe can then home onto the 
target word faster by avoiding the comparison of different words of same length. 
Note that the seed value need not be unique for all the words m the dictionary. It 
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must hv unique for all the words in a single block or partition of the dictionary. The 
modified r<*<ord structure is shown in Figure 3.10. 



Length of word 
hash value 

Word bytes 
Attribute length 

Attributes 


Figure 3.10; Modified dictionary record structure 


3.11.2 Improving The Order of the Search Algorithm 

'I'he s<‘arc!i algorithm employed by the DiSe has a conftplexity of 0(n), where n 
is the number of words in the dictionary block loaded into memory. By changing 
the architecture slightly we can reduce the search algorithm complexity to O(lgn) 
(emj)lov binary searrli). For binary search the data must be sorted. Instead of 
placing the words in a sorted order we introduce a new data-structure which gives a 
sorted view of the words. The memory organization, shown in Figure 3.11, changes 
slightly with the introduction of this data structure. It is basically an array of 
pointers to records. This data structure is preceded by its length. A simple binary 
search can now be implemented. 

During the course of the binary seardi the upper and lower bounds of the array 
keep changing. At each stage calculation of a new bound requires a division by 2 
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length of source word 
Source word bytes 

SouTcehash value 
Length of word list 

Word list contains just 
pointers to records 

List of records 


Kigurr 3.11: Input data format for binary search 


oj)<‘ralian. This can lx* iniplcniented by a simple right shift of the dividend. There 
is no need to introduce a new divider unit. 

3.11.3 Implementing n— way Comparison 

In the present itnpleinentation, the input and the dictionary words are compared 
byte by byte. 'Phis is because the data bus is only 8-bits wide and can only fetch 
a byte at a time. By using a 64-bit data bus 8 bytes can be fetched at a time. 
The comparator must now be capable of comparing two 64-bit operands at a time. 
There is a high probability that if two words are different then the mismatch may 
be detected in the first 64 bits( at least for English language words). In most cases 
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w<‘ may l«* able to docido on the equality of the words in just one comparison. 

On the average, half of the memory (n/2 words) will be checked for every 
search. Assuming a normal data distribution, this implementation requires only 
n/2 comparisons. The number of comparisons can be improved to a worst case 
Figure of Ig n if this method is used in conjunction with the binary search method 
mentioned earlier. 

Of course, this concept can be extended to data-bus bandwidths of up to 128 
bits as the int<’rnal source- wor<i-cache can cache up to 16 input-word bytes. 


3.12 Pseudo-code for the DiSe Model 

Tins sectioii pmsentH, in pstnido-code, the various operations performed by the DiSe processor, in 
each state. 


3.12.1 state : RESETTING 

1. Wait for falling edge of phi2 

2. If react in 'O’ then goto state S.O 

3. goto i 

3.12.2 State : S_0 

1. Fetch byte from memory Jocation X’'000' 

2. Store in SHr.LKNGTH register 

3. gotcj S-1 

3.12.3 State : S_1 

1. Increment PC 

2. Read byte from memory location pointed to by PC 
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3 Writr thr bytr into source register file 

4 If (ouni.16 i« anwrted then 

• Ssve PC in SRC.OFFSET register 

• If SRC.LENGTH is equal to 16 set ccJL flag 

• Load PC with X'lOl" and reset count.16 

• gotoS.2 

r> If is not asserted then 

• If PC value is 1.-ks than SHC.LKNCTH goto 1 else 

• Save PC’ in SRC .OFFSET register 

• Load PC’ with X"10r’ and reset count.16 

• goto S J? 

3.12.4 State : S_2 

1. Fetch thr Ungth of the current word 

2 If Ungth is not equal to SRC-LENGTH goto FAILURE 

3 If Ungth is equal to SRCXENGTH then 

• store Ungth in CUR.LENGTH register 

• if CUR.LENGTH is not equal to SRCJLENGTH then 

Adjust PC’ to point to attribute length 
Fetch attribute length 

Adjust PC to point to beginning of next record 
goto S 

• if CURXENGTH is equal to SRC.LENGTH then 

Store PC in TEMPI register 

Store PC + CURXENGTH in TEMP2 

gotoSJ 



3.12.5 State : S_3 

1 liirmiirnt PC by ! 

2 Frtch h cur«hytr from the current word 

3 Fetch II Sre Jiyle from source register file 

4 If srr .byte is not equal to cur. byte then 

• If source register file has to be refreshed then 

Store PC contents in Cim. LENGTH 
gnt«^ S.5 

• If source rt*gister file doesirt nml a refresh then 

Adjust P(' to point to next record 
goto SJ2 

5 If src.byle is equal to cur-byte then 

• If this was the last hyte then goto SUCCESS 

• If this wa.s bist byte in fiouree register file then 

Store !H' contents in CUR. LENGTH 
goto $A 

« If this was not the last byte then goto 1 


3.12.6 State : S_4 


1, Inrrenjeiil PC by 1 

2. Fetch a source word byte from memory 


3. Store the byte in source register file 

4. If source register file is full then 

♦ Store PC in SRC.OFFSET register 


♦ Restore status of PC to pre 

• goto SJ3 
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5 If iwnirfr rrgiHtrr filr if^ not full thru 


• If nil iKiurcr won! bytrf^ have been fetched then 

Stnre VV in SRC .OFFSET register 
Restore status of PC to pre S-4 entry value 
goto SJi 

• If all source word bytes have not been fetched then goto 1 

3.12.7 State : S..5 

1 , liirrmiriil ‘ b) I 

2 Hmc! A w>urcr ffoin nwiimry 

3. Store the source byte in source register file 

4 If WHirce register file is full then 

• St«>ri' l‘(‘ iJt SHC’.OFFSKT register 

• stfttus of IH’ to pre S.h entry value 

• Adjust l’( ' to puint to next record 

• goto S.2 

5 If source register file is not full then 

• If all w.urce word bytes have been fetched then 

Store PC in SRC .OFFSET register 
Restore status of PC to pre S.5 entry value 
Adjust PC' to point to next record 
g(#!(i SJ2 

• If all fiourcc byten have* not been fetched goto 1 

3.12.8 state : SUCCESS 

1. Write the lower 8 bits of TEMPI into memory X 000 
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‘J Wriiti- til*’ iiitiirr 8 hiti. of '1 KMl’l into iiiomory X^OOl” 

3 S«’t ri'Mill port to T 

4 goto Miktr IDLf: 

3.12.9 State : FAILURE 

1 Wntr thr vuliir X’*0” into nirinory X^OOD” 

2 Wrtir thr viihir X**0’‘ inmiory X"‘001” 

3 Srt rr^nh port to T 
*1 goto jitHtr IDLl". 

3.12.10 State : IDLE 

1 Du nothing until rr?»rt is msrrtvil 
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2. Writ*' thr uj>por 8 bits of TEMPI into memory X"00r 

3. Set reiiiilt port to 

4. goto KtHte IDLE 

3.12.9 State : FAILURE 

1. Write the value X^O" into memory X”000’' 

2. Write the value X'"0" into memory X’'00r’ 

3. Set renuli port to 

4. goto state IDLE 

3.12.10 state : IDLE 

I, Do nothing until reset is aus.serted 



Chapter 4 


Test Bench For The DiSe Processor 

4.1 Introduction 

'I'his chapter describes the design of a test bench circuit that was used in the testing 
of the DiS( processor. Figure 4.1 shows the organization of the test bench circuit, 
lest bench was modeled in VHDL. 

The test bench consists of three main components 

1 . A clock-generator device 

2. A memory device and 

3. The DiSc processor 

The clock generator device generates the two-phase clock and the reset signal 
to driv'c the processor. The memory device stores the test data. The behavioral 
models of all three components were connected together in a structural description 
of the test bench. 
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Figure 4.1: Test bench circuit for the DiSe 


4.2 Clock Generator 

The clock generator has two formal generic constants. TpW is the pulse width for 
each of phil and phi2, i.e, the time for which each clock signal is ‘1’. TpS is the pulse 
separation, the time between one clock signal changing to ‘0’ and the other clock 
signal changing to ‘1’. Based on these values, the clock period is twice the sum of 
the pulse width and the separation. 

The architecture of the clock generator consists of two concurrent statements, 
one to drive the reset signal and the other to drive the clock signals. The reset 
driver schedules a ‘1’ value on reset when it is activated at simulation initialization, 
followed by a ‘0’ a little after two clock periods later. This concurrent statement is 
never subsequently reactivated, since its waveform list does not refer to any signals. 
The clock driver process, when activated, schedules a pulse on phil immediately, 
followed by a pulse on phi2, and then suspends for a clock period. On resuming, it 
repeats scheduling the next clock cycle. 
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4.3 The Memory Device 

'i’hr architecture body consists of one VHDL process statement to implement the 
behavior. The process contains an array variable to represent the storage of the 
iiienK>ry. When the process is activated, it places the output ports in an initial state 
where the data bus is disconnected and the ready bit is negated. It then waits for 
a read or write command. When one of these occurs, the address is sampled and 
converted from a hit vector to a number. If it is within the address bounds of the 
m<*iiK»ry, the command is acted upon. 

For a write command, the ready bit is asserted after a delay representing the 
write acce.ss tiiiu* of the memory, and then the model waits until the end of the 
write cycle. At that time, the value that existed on the data bus a propagation 
delay before tl»e current time is sampled and written into the memory array. The 
use of this delayed value models the fact that memory devices actually store the 
data that was valid before the triggering edge of the command bit. 

I’or a read command, the data from the memory array is accessed and placed 
on the data bus after a delay. This delay represents the read access time of the 
memory. The ready bit is also asserted after the delay, indicating that the processor 
may continue. The memory then waits until the end of the read cycle. 

At the end of a memory cycle, the process repeats, setting the data bus and 
ready bit drivers to their initial states, and waiting for the next command. 

4.4 Test Bench Circuit 

Figure 4.1 shows the structural architecture of the test bench circuit. The entity 
contains no ports, since there are no external connections to the test bench. The 
architecture body contains component declarations for the clock driver, the memory 
and the DiSe processor. The ports in these component declarations correspond 
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_ Table 4,1: Test 

Data No. 


1 Memory Location 

Word 

Length 

From 

To 

0001 

0005 

Heart 

5 

0007 

0011 

Heard 

5 

0016 

0019 

Head 

4 

0023 

0027 

Heart 

5 


Htari. The state of the processor and the bus transactions at various points of time 
are shown in table 4.2. The first column shows the time at which the processor 
<*ntered a particular statefshown in the last column). The second column shows the 
value on the address bus at that instant and the third column shows the value on 
the data bus at the same instant. The fourth column shows the time till which the 

processor remains in the particular state, 

I'he lengthfentry in column 6) of the input word is fetched first as shown in the 
third row of table 4.2 followed by the search word itself as shown in the fourth row. 
'I'he first word in the dictionary area is ’’Heard”. Since its length matches the search 
wor<l length, the processor proceeds to match the two words(row 6). A mismatch 
occurs in the last letter. The second word, “Head”, is only 4 bytes long and thus is 
8kipped{row 7). The third word, “Heart”, is of the same length as the search word 
so the processor proceeds to compare it with the search wordfrow 9). The two words 
match byte for byte. The search terminates in the SUCCESS state(row 10). The 
result pin is set to 1, and the processor goes into an idle state waiting for the next 

word to be searched. 

This test case was designed to check the very basic functionality of the DtSe 
processor. The results indicate that the model works for all words which are less 

than or equal to sixteen bytes in size. 
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Tabic 4.2: SiinulttliQn TVace of Data No. 1 


Time 

A Bus 

DJBus 

Time 

AJBus 

DJBus 

State 

0 

null 

null 

0 

null 

null 

IDLE 

0 

null 

null 

47 

null 

null 

RESETTING 

48 

0 

null 

120 

0 

5' 

S_0 

162 

1 

H 

521 

5 

t 

S.1 

" 541 

‘6 

0 

601 

6 

5 

S.2 

642 

1081 

1221 

7 

Hi 

1001 

li 1 

d 

S-3 

j-5 

d 

1140 

15 

4 


22 

0 

1281 

22 

5 

SJ2 

T322"' 

1731 “ 

23 

H 

1681 

27 

t 

S-3 

"F 

22 

- 

1 

6 

SUCCESS 

- 

0 

0 

- 

d 

0 

IDLE 


4.5.2 Test Case 2 


1-451- 

1 Memory Location 

if*st uaia i\o. 4 

Word 

Length 

FVom 

To 

000 i 

0255 

x(49)Hx(204)H 

255 

0257 

0511 

x(255) 1 

255 

0521 

0775 1 

x(49)Hx(204)H 

255 


'rhc DiSr processor was run on the test data shown in table 4.3. The simulation 
tra«- is shown in tnblp -l.^. The search siring is 255 bytes long. A page of the source 
word data inrlmles 16 source word bytes. The first 16 b.vtes(page) of the source 
word are fetcl.ed and stored in the sonree cache. The first word in the dictionary 
area is also 25.5 bytes long. The processor matches the wo words. After the first 
sixteen bytes, the source cache is loaded with the next page of source word bytes. 
A third page is leaded after the two words match in, the first 32 bytes. A mismatch 
occurs in the 5011. byte. The search begins afresh with the next word, with the 
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[a ble 4.4: Simulation l>ace of Data No. 2 


Time 

A .Bus 

DJBus 

Time 

AIWVV Vi 

A3us 

D.Bus 

State 

d 

null 

null 

0 

null 

null 

IDLE 

0 

null 

null 

47 

null 

null 

RESETTING 

48 

0 

null 

120 

0 

255 

S_0 

162 

1 

X 

1420 

16 

X 

S_1 

1421 

256 

0 

1481 

256 

255 

S.2 

1501 

257 

X 

2780 

272 

X 

S_3 

2781 

17 

X 

4060 

32 

X 

S.4 

4061 

273 

X 

5340 

288 

X 

S.3 

5341 

33 

X 

6620 

48 

X 

S-4 

6621 

289 

X 

7900 

304 

X 

S-3 

7901 

49 

X 

9180 

64 

X 

S.4 

9181 

305 

X 

9340 

306 

X 

S-3 

93411 

1 

X 

10600 

16 

X 

S-5 

10601 i 

512 

0 

10661 

512 

7 

S-5 

10681 

520 

0 

10741 

520" 

255 

S-2 

10761 

521 

X 

12040 

536 

X 

S-3 

12041 

17_ 

X 

14600 

32 

X 

S-4 


- 

- 

- 

- 

- 

S.3/4 

47881 

240 

X 

49061 

255 

H 

S-4 

49081 

761 

X 

50261 

775 

H 

S-3 

50281 

0 

d 

50342 

d 

8 

SUCCESS 

50343 

1 

0 

50402 

i 

2 

SUCCESS 

- 

- 

- 

- 


- 

IDLE 


sourer cache being loaded with tlie first page. This word matches the source word 
in all the 255 bytes. The search is ended with success. 

In normal operation it is highly unlikely that such a data set will be encountered. 
It is designed to check the caching and paging operations of the source buffer. Paging 
is required only if the word lengths exceed 16 characters. Most of the characters m 
the words were set to x where an i represents a blank character. A series of n blank 
characters occurring in a word is represented as x(n) in the table. The results of the 
test run are tabulated in table 4.4 . 




Chapter 5 

The MiDiCal Processor 

5.1 Introduction 

I’ljis chapter discusses the architecture and design of the MiDiCal( Minimum Dis- 
tance (’ahulatioii) processor. In the HEBMT system, the source language input 
sentence, IS, is compared against all the examples belonging to its syntactic category, 
to fiiui the example which is closest in meaning to it. The example-base is partitioned 
on the basis of the syntactic categories of the sentences, i.e, all sentences belonging to 
one syntactic group go into one partition. This partition may further be partitioned 
on the basis of other sub-attributes. A HEBMT system assigns certain attributes 
to the IS. based on information gleaned in the previous phases. Based on these 
attribute.s a distance function is used to calculate the distance between the input 
s('iitcnre and each sentence of the example-base. The sentence with the minimum 
distance is output as the tran.slation in the target language. For a full fledged 
HEBMT system the example-base contains a large amount of data. The partitions, 
with the best partitioning schemes, may still contain a lot of data. So the distance 
calculation phase is a bottleneck in the system. This bottleneck can be greatly 
reduced if the distance matching algorithm is implemented in hardware. This 
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chapter presents the architecture and design of an ASIC which can be used in 
speeding up the distance calculation algorithm. The chapter is organized as follows: 

1 . The distance calculation function. 

2. Instructionlcss processor. 

3. Input data format. 

4. The MiDiCal processor interface. 

5. 'i'he MiDiCal bus protocol. 

6. Architecture Modeling: Component description. 

5.2 The Distance Calculation Function 

'I’he distance hetwe<>n the input sentence, IS, and the example-base sentence is 
calculated according to the mathematical function given below : 

d{/5, ES) = f: d,{JSG, ESG) -f d^SV, ESV) (5.1) 

pssl 

where n is the number of noun syntactic groups in the IS and ISG and ESG are 
“input sentence noun syntactic group” and “example sentence noun syntactic group 
re.spoctively. and ISV and ESV are Input and Example sentence verb groups. 

ESC)~ distance between the pth noun syntactic groups of input and 
<*.xaiuple source language sentence 

dAlSWESV)- distance between the verb group of input and example source 
language sentence 

dpilSG, ESC) = (wl X ATD -I- ti;2 x ASD)l{wl + w2) 

ATD = iql xSD-\-q2x (GD + ND + PD))/{ql + ^2) 
d,{lSV,ESV) = VCD 
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whore AID, SI), GD, ND, PD, ASD and VCD are attribute difference, status 
difference, gender difference, person difference, additional semantic difference, and 
verb category difference between example sentence and input sentence. wl,w2,ql,q2 
are weights assigned to distance parameters according to their effect on translation. 
Additional semantic difference is retrieved from the semantic difference table. Ad- 
ditional semantic difference table is generated based on a hierarchy of semantic tags 
in the .semantic network. The original paper on HEBMT(Jain et. al.[l]) contains a 
more detailed description of the distance calculation algorithm. 


5.3 Instructionless Processor 

The pros and cons of an instructionless processor versus an instruction-set processor 
have been discus-sed in chapter 3. The MiDiCal processor has been implemented as 
an instructionle.ss processor. The reason is that the distance calculation algorithm 
lends itself to a very simple and straightforward datapath implementation. 

5.4 Input Data Format 

This section presents the format in which data must be fed to the MiDiCal processor. 
Figure 5.1 shows the memor}’ organization. Note that the memory contains only 
abstracted example. The memory basically contains 

1. The abstracted input sentence and 

2. Some source language patterns from the example-base. 

The format of the input sentence is shown in Figure 5.1(b). The first word(4 
bytes) are reserved for the BITMAP. The first n bits in the BITMAP are set to 
indicate the number of noun phrases in a sentence. The next six words are reserved 
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for tho values of <jl, <j2, <}l+<j2, wl, w2, and wl— w2. The word (4 bytes) beginning 
at the 52nd byte holds the value of the WORK_AREA_ADDRESS. This is a pointer 
to a location in memory where the processor can write the results after finding the 
sentence with the minimum distance. The 56th byte holds n, the number of noun 
phrases. The 57th byte holds the value n-1. The next byte holds the input sentence 
verb property. The next byte contains the actual table size of noun phrases. This is 
followed by a table of noun phra.sp bytes and a table of additional semantic difference 
bytes(AS!)). 

'I'he format of the example sentences from the example— base is shown in Fig- 
ure 5.1(c). Each sentence begins with a table of noun phrase bytes followed by a 
table of corresponding additional semantic difference bytes. The tables are followed 
by a byte for the example sentence verb (ESV). Two more bytes hold a pointer to 
the next s<‘ntence in the example ba.se. This field followed by some arbitrary number 
of bytes where any information about any of the noun phrases can be stored in any 
format as desired by the designers of the machine translation system. 

'I'he organization of the noun phrases needs some explaining. Each noun phrase 
is allocated one byte of nremory. The attributes of the noun phrase are encoded in 
the bits of the byte as follows : 

• Bit— 7 and bit— 6 represent the status( animate, inanimate, etc.) of the noun 
phrase. 

• Bit -5 an<l bit— 4 represent the gender(masculine, feminine, neutral) of the 
noun phras<‘. 

• Bit— 3 and bit— 2 represent the number{singular, plural) of the noun phrase. 

• Bit-1 and bit-0 represent the person(first person, second person, etc.) of the 
noun phra.se. 
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Figure 5.2: MiDiCal interface 


5.5 The MiDiCal Processor Interface 

'I’hc port diagram of a MiDiCal processor is shown in Figure 5.2. The processor 
interfaces to the memory module through a synchronous, unidirectional, 16 bit wide 
address bus. Data flows between the processor and the memory module through a 
bidirectional, 32 bit wide data bus. The read and write single bit ports are used 
to control read and write transactions. The ready port is used by the memory 
nuxlule to signal the availability of data on the data bus in a read transaction, and 
its readiness to accept data in a write transaction. The result port is used by the 
MiDiC’al proc essor to signal a master proces.sor that it has finished with the current 
set of data. 'I’he processor is driven by a two phase clock. The two ports, phil and 
phi2, provide the two phase clock. 
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5.6 MiDiCal Bus Protocol 

Thf' prufrssor f«IU*ws the same read and write bus protocols as the DiSe 

prori’ssor. 'I’hr dork signal diagram, the bus road, and bus write timing diagrams 
are identirai to the ones shown in chapter 3. 


5.7 Architecture Modeling 

This MTtiiiii disetisses tlie arrhitecture of the MiDiCal processor. The processor was 
inociele<i in the Wrilog hardware description language. The processor was modeled 
structurally at a very high Icwl and the components were modeled behaviorally. 
Figure 5.3 shows the architecture (block level) of the MiDiCal processor. There are 
4 main blocks or units in the figure. Units B, C, and D are simple enough and their 
bh»rk diagrams .show sufficieni detail. Figure 5.4 shows a more detailed diagram of 
unit A. 

The folh»wiiig are some of tlie main components used in the modeling of the 
prori’ssur 

1 . The logic controller 

2. An integrated floating point addition and division unit 

3. A floating point inuitiplication unit 

4. A data fetch and dispatch unit 

5. Hegi.ster files. 

6. a floating point comparator unit. 

7. An integer addition unit. 

8. A noun phrase comjrarator unit. 
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Fig.,, 5.3: Ar,l.it««>" ot the MiDiCal prooeaaor 
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Figure 5.4; Detailed layout of UNIT-A 


9. ASl) comparator unit. 

'Phe logic controller has been implemented as a state machine. In the following 
(liscussioii, the behavior of the MiDiCal processor is sketched algorithmically and 
the behavior of each component is described as and when needed. 
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5.7.1 The Logic Controller Unit 

This unit provides control signals to all the components of the processor and co- 
ordinates all their functions. When the processor is powered on, it is placed in 
the idh state. The processor continuously loops in this state waiting for the reset 
signal to be asserted. Meanwhile the master processor loads the memory with some 
data and resets the MiDiCal processor. The logic controller puts the processor in 
the lUCSfyiTlNG state and waits for the negative edge of the reset signal. At this 
point, the processor moves to state S_0 and the actual working of the processor 
starts. 

S_0 : In this state the processor gathers all the information about the current 
data set and stores that information in its internal registers. Some of this information 
is static in nature, i.e, doesn’t change throughout the course of the processor’s 
operation. The processor performs the following actions in this state : 

1. ketch the Hl'rMAP string from memory[0:3] and store in register BITMAP. 

2. Fetch the value of ql from memory f4:7] and store in register REG.ql. 

3. Fetch the value of q2 from memory[8:ll] and store in register REG-q2. 

4. Fetch the value of qH-q2 from memory[12:15] and store in register REG_qsum. 

T). Fetch the value of wl from memory[16:19] and store in register REG-W'l. 

(). Fetch the value of w2 from memory[20;23] and store in register REG_w2. 

7. Fetch t he value of wl -|-\v2 from mcmory[24:27] and store in register REG-W'sum. 

8. Fetch the value of SD from memory[28:31] and store in register REG-sd. 

9. Fetch the value of GD from memory[32:35] and store in register REG_gd. 

10. Fetch the value of ND from memory[36:39] and store in register REG_nd. 
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11. Fetch the value of PD from memory [40:43] and store in register REG_pd. 

12. Fetch the value of ASD from memory [44:47] and store in register REG-asd. 

13. Fetch the value of VCD from memory[48:51] and store in register REG-vcd. 

14. Fetch the value of Work .area _ad dr from memory [52:53]. 

15. fetch the number of noun phrases from memory [53] and store in register 
NOF-np. 

16. Fetch the value of ISV from memory [54] and store in register ISV. 

17. Fetch the size of the table of noun phrases, in bytes, from memory [55] and 
store in register PTAB_SZ. 

S_l: 3'he process of distance calculation involves the comparison of certain 
attribut<>s of the input sentence and the current sentence from the example— base. 
'I'he noun phra.se attributes of the input sentence are stored in a table called PTAB 
and the ASD for each noun phrase is stored in a table known as the ASDTAB. 
In this state, the processor sets up its internal registers to point to the PTABs and 
ASD'FABs of the input sentence and the current sentence of the example- base. The 
steps followed are as under : 

1. Set SRC.PTAB.BASE register to point to the base address of the input 
sentence noun phrase table. 

2. Set SHC_ASDTAB-BASE register to point to the base address of the input 
sentence ASD tabic. 

3. Set SRC-PTAB-OFFSET register to point to the first entry of the input 


sentence PTAB. 
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4. Set SRC-ASDTAB_OFFSET register to point to the first entry of the input 
sentence ASDTAB. 

5. Set CUR_PTAB_OFFSET register to point to the base address of the PTAB 
of the first sentence in the example base. 

6. Set ClTR-ASDTAB_OFFSET register to point to the base address of the 
ASDTAB of the first sentence in the example base. 

Now the proce.ssor is ready to fetch and compare the input sentence and a 
sentence from the example base. 

S_2: The processor fetclies 4 bytes from the input sentence PTAB and ASDTAB. 
The SRC_PTAB_OFFSET and the SRC-ASDTAB_OFFSET are incremented by 4. 
The same steps are repeated for the current sentence from the example base. Note 
that the processor fetches 4 bytes even if the number of noun phrases is less than 4. 
'I'his is becfuise the PTAB and the ASDTAB sizes arc multiples of 4. 

1 . Fetch 4 bytes from input sentence PTAB. Store in register SRCJPROP-WORD. 

2. Increment SRC.PTAB.OFFSET by 4. 

3. Fetch 4 bytes from current sentence PTAB. Store in register CUR-PROP_WORD. 

4. Increment CUR.PTAB.OFFSET by 4. 

5. Fetch 4 bytes from input sentence ASDTAB. Store in register SRC_ASD_WORD. 
fl. IncnuiK'nl SHC-ASDTAB.OFFSET by 4. 

7. Fetch 4 bytes from current sentence ASDTAB. Store in register SRC_ASD_WORD. 


8. Increment CUR.ASDTAB.OFFSET by 4. 
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S_3 : The processor compares the four bytes in the register SRC_PROP-WORD 
with those in CUR-PROP-WORD. The above two registers contain noun phrfises 
fetched from the input sentence and current sentence PTABs. It is not necessary 
that all the four bytes be noun phrases. Some of the bytes could be padded bytes 
to make the PTAB size an exact multiple of 4. For each noun phrase, the four 
properties viz. SD, GD, PD, ND, are checked for equivalence. The results are stored 
in flags SD(1:4), GD(1:4), PD(1:4), ND(1:4). A flag is set to 1 if the corresponding 
properties are equal. 

Similarly, the ASD tags stored in CUR-ASD-WORD and SRC-ASD_WORD are 
compared. The flags F_ASD1_EQ, F_ASD2_EQ, F_ASD3-EQ and F_ASD4_EQ are 
set to 1 if the corresponding tags match. 

S_4 : The MiDiCal processor has 4 multipliers and 4 ADUs (Addition and 
Division units) internally. As can be seen from equation 1, only three operations are 
involved in the distance calculation process- addition, division and multiplication. 
Hinc<* the proces.sor processes a maximum of only 4 noun phrases at a time, each noun 
phra,se is asvsigiu'd one multiplier and one ADU. As mentioned earlier, the number 
of noun phrases may be less than 4. In such situations the processor disables those 
multipliers and ADUs which do not have a noun phrase assigned to them. Once 
tlic processor fetches 4 bytes from the PTAB it knows exactly which byte is a valid 
noun phrase. This is because for every valid noun phrase there is a corresponding 
bit in the BITMAP register which is set to 1. 

In this state, the logic controller calculates the distance between each of the four 
input sent<-nce noun phrases and their corresponding example sentence noun phrases. 
'I'hi.s invoh-es loading the ADUs and the multipliers in a particular sequence, col- 
lecting the intermc’diate results and synchronizing the operation of all the execution 
units. The loading operations are performed b}' 4 concurrent processes which are 
synchronized by the logic controller. The basic requirement is that the execution 
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Table 5.1: Operation Scheduling 


Time 

operation 1 

operation 2 

0 

Tl = GD + PD 

Tl = ql * SD 

1 

T2 = Tl + ND 


4 


T2 = q2 * T2 

8^ 

Tl = Tl + T2 

Tl = w2 * ASD 

"9 

T2 = Tl/{qH-q2) 


12 


T2 = wl ♦ ATD 

16 

Tl = Tl 4 T2 


17 

T2 = T1/(w14w2) 



units must be loaded with operands at the same time and must produce results at 
the same time. All operations are floating point operations. The add operation 
takes 1 unit of time and the divide and multiply operations take 4 units of time. 
1'h<* s<*<ju<Mice in which the operations are executed is shown in table 5.1. The first 
cohnnn d<'not<'s flu- time at which the operations in columns 2 and 3 are started. 
From the first row in table 5.1 it appears as if the results of operation 1 as well as 
the r<‘su!ts of operation 2 are being assigned to register Tl simultaneously. This 
is not the case. Only the operations are being scheduled at time 0. The result of 
operation 1 will be av'ailable 1 time unit later in Tl. The results of operation 2 are 
available 4 time units later when its safe to load Tl with any value. 

S_5 : In this state the processor adds the distances that it calculated in the 
previous state to the running sum stored in the register M1N_D1ST. 

S-6 : 'I'he ptt)<-«‘.ssor has to determine whether there are any more noun phrases 
that reinaiii tt> !>«* haiidletl. I'or this, the Bll MAP registei is shifted light bjr 4 bits. 
If the most significant bit still happens to be 1 then it means that there are still 
8om<‘ noun phra.ses which must be handled. The processor then changes state to 

S-2. 
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However, if the last noun phrase has been taken care of then the distance between 
the input sentence verb phrase and the example sentence verb phrase is calculated. 

S_7 : In this state the processor adds the VCD to the running sum stored in the 
register CUR JDIST. 

S_8 : The distance of the current sentence, stored in the register CIIR.DTST, 
is compared with the minimum distance calculated so far which is stored in the 
register MIN.DIS'I'. If the value in CUR-DIST is less than the value in MIN-DIST 
then MIN.DIST is loaded with the value in CURJDIST. The base address of the 
current sentence is stored in the register M1N_SENTENCE_BASEADDR. 

The processor checks if the current sentence is the laat sentence in the example 
base. If it is the last sentence then the processor changes state to S_9. Otherwise the 
processor sets the CUR.PTAB.BASE, CIIR.PTAB.OFFSET, CUR_ASDTAB_BASE, 
CU R.ASDTAB.OFFSET to point to the next sentence. The BITMAP string is 
rel(»a<le<l from immiory. 'I'lic SRC.PTAB.OFFSET and SRC-ASDTAB.OFFSET 
an' r<*s<*t and state changes to S.2. 

S-9 : 'I'his state is entered when the processor finishes processing the last 
sentence in the data set. 7'he minimum distance calculated and the base address 
of the minimum distance sentence are written into memory at an address pointed 
to by the register WORK_AREA_ADDRESS. The processor then changes state to 
IDLE. 

IDLE : The processor goes into a loop waiting for the I'esel signal to be activated 
again. 

5.7.2 The ADU 

I'he ADU has been implemented as a verilog model. It has two ports, operand-1 and 
opcmnd.2 for two 32-bit operands and a result port for the result of an operation. 
The command port indicates the operation to be performed, i.e, addition or division. 
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The go port enables the operation and the done port signals the completion of an 
operation. 

5.7.3 The Multiplier 

The Multiplier has been implemented as a verilog model, operand.l and operand.2 
ports hold the two 32-bit operands while result holds the 32-bit result of the multipli- 
tation. Ihe go port enables the operation and the done port signals the completion 
of an operation. The corninand port indicates the function to perform, i.e, multipli- 
cation or pass. 

5.7.4 The Floating-point Comparator Unit 

This unit has two ports op.I and op.2 which hold the two input 32-bit operands. It 
has a n.s port which outputs the lesser of the two operands. The enable port enables 
the operation aiui the done port signals the completion of the comparison. 

5.7.5 Integer Adder Unit 

'Flu' integer adder is a carry lookahead adder. It has two ports op_i and op.2 which 
hold the two operands and a sum port which holds the sum. The port c-0 holds the 
carry in to the zeroth bit and the port c.out holds the carry out from the last bit. 
'I’he go port enables the addition operation and the done port signals the completion 
of the operation. 

5.7.6 The Data Fetch and Dispatch Unit 

In our implementation of the MiDiCal processor we have integrated this unit into 
the logic controller. This unit implements the bus read and write protocols. It has a 
If) bit r<‘gister, MAR, which drives the 16 bit unidirectional address bus. The 32 bit 



77 


register, MDR, holds the data which drives the 32 bit data bus when the processor 
is writing to memory. The MDR also holds the data that is read in by the processor 
from memory. 

5.7.7 Register Files 

Most of the registers are packed into four register files. MiDiCal has three 32- 
hit floating-point register files (FP-1, FP-2, FP-3) and one 16-bit integer register 
file(INT-KFC;). 

FP-1 has 6 floating point registers - REG.ql, REG_q2, REG.wl, REG_w'2, 
HEG-SD and REG_ASD. It has two read ports rl and 7'2and a write port wl. Each 
one of these ports has associated with it an enable port(e7?7, en2 and enS), and an 
address port{fl/, a!? and aS). 

FP-2 has 6 floating point registers - REG.GD, REG.ND, REG-PD, REG_wsum, 
HFG.qsum and Rl'XJ.vcd. It has two read ports rl and v2 and a write port wl. 
Ea<'h one of these j)orts ha.s associated with it an enable port, enrl, enr2 and enwl, 
and an addre.ss port, arl, ar2 and awl. 

FP-3 h^s 9 registers - exLTl, exl_T2, ex2_Tl, ex2_T2, ex3-Tl, ex3_T2, ex4-Tl, 
ex4-l'2 and GUR.DISl’. It has 12 read ports rl to rl2 and 9 write ports wl to w9. 
Each write port has an enable port associated with it and an address port associated 
with it. 

XNT-REG has thirteen 16-bit registers. It has 2 read ports, rl and r2, and 1 
write port, ti'l. Each port lias an enable port and an address port associated with 
it. 

'I’he remaining registers are independent registers in the sense that they have 
not been pool<*d into register files. 
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5.7.8 Noun Phrase Comparator Unit 

The MiDiCal processor fetches a 4 noun phrases from the source PTAB and a 
similar number from the current PTAB. Each noun phrase byte contains the four 
attributes- SD, GD, PD, ND. The noun phrase comparator unit takes the two 
words as operands. It checks each one of these attributes and sets some flags if 
the attributes match. 

The interface includes two 32-bit operands op.l and opS, an enable pin en and 
l(i output flags. 

5.7.9 ASD comparator 

I'he processor fetches 4 bytes from the source ASD table and 4 bytes from the current 
ASD table. Each byte holds the additional semantic difference for a corresponding 
notin phra.se in the PTAB. The ASD comparator takes these two 32-bit operands 
ami c<>nipar<‘s th<'m “bytewise”. The four output flags F.ASD1_EQ, F_ASD2JEQ, 
F-AS1)3.EQ, h'.ASD-LEQ are set if the source ASD word and the current ASD word 
match in the first, second, third and the fourth bytes respectively. 

The interface includes two 32- bit operands op.l and op-2, an enable pin en and 
4 output flags F-ASD1_EQ, F_ASD2_EQ, F.ASD3-EQ, FASD4_E. 


5.8 Simulation Results 

'I'liis section contains simulation results of the MiDiCal processor. The processor 
was .simulateti using a test bench circuit similar to the one used for the simulation 
of the DiSt jjroces.sor. However, this test bench was written in the Verilog hardware 
description language. Table 5.1 contains the parameter values used in the simulation. 
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Table 5.2: 1 

MiPiCal Simulation ] 

^arametei 

rs 

BITMAP 

qi 

q2 

qH-q2 

wl 

w2 

wH-w2 

2 

2.0 

0.5 

2.5 

1.0 

1.0 

2.0 

SD 

GD 

ND 

PD 

ASD 

VCD 

W.A.Address 

0.5 

0.5 

0.5 

0.5 

0.5 

0.5 

1024 


Table 5.3: Test Data 1 


Sentence No. 

NPl 

NP2 

ASDl 

ASD2 

VERB 

input Sentence 

FF 

FF 

FF 

FF 

00 

Example 1 

FF 

FE 

FF 

FF 

00 

Example 2 

OF 

FE 

8F 

FF 

11 


5.8.1 Test Case 1 

The test data is shown in table 5.2. The input sentence contains just tw'o noun 
phrases. The o.xainplc base is shown to contain two examples. The processor 
calculates the dist ance of the input sentence from the two sentences in the example 
base and rightly indicates the first sentence in the example base as the sentence 
closest in meaning to the input sentence. 

5.8.2 Test Case 2 

Table 5.3 shows the second test data set. The input sentence contains 5 noun 
phrases. The BITMAP field is thus set to show 5 noun phrases. The example base 
contains 2 examples. The second example matches the input sentence more closely. 
Tlu' processor thus outputs the second sentence as the result. 
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Table 5.4: Test Dat a 2 


Sentence 

NPl 

NP2 

NP3 

NP4 

NP5 

Input Sentence 

FF 

FF 

FF 

FF 

FF 

Example 1 

OF 

FC 

FF 

FF 

FF 

Example 2 

FF 

FE 

FF 

FF 

FF 


Sentence 

ASDl 

ASD2 

ASD3 

ASD4 

ASD5 

VERB 

Input Sentence 

00 

00 

00 

00 

00 

AA 

Example 1 

FF 

01 

00 

00 

00 

OA 

Example 2 

00 

01 

00 

00 

00 

AA 


5.9 Future Directions 

This sections suggests some improvements to the MiDiCal processor. The improve- 
ments are architectural enhancements. Logic gate level optimizations are not covered 
here as the chip was modeled only at a behavioral level. 

5.9.1 Bit-sliced Architecture 

The MiDiCal processor, as it was implemented, contains only four execution units 
which can operate on four noun phrases at a time. A better solution would be to 
build a bit-sliced architecture which can scale with the number of noun phrases 
that must be handled. Those sentences which have more number of noun phrases 
can have more bit sliced processors working on them. 

5.9.2 Choosing ‘n’ Sentences 

'rhf i)rocessor was designed to select just one sentence from the example base which 
is closest in meaning to the input sentence. Often it may be necessary to select 
more than one sentence from the example base. The processor must be upgraded 
to incorporate this feature into it. 



81 


5.9.3 Pipeline Architecture 

The present architecture is a superscalar architecture. All the four execution units 
operate in parallel. There is a lot of scope to pipeline operations. The memory 
operations can be pipelined with the minimum distance calculation operations. This 
would significantly improve performance. 

5.9.4 Low Power Design 

It is very important to conserve power in a massively parallel processor. So another 
important improvement is to build a low power version of the MiDiCal processor. 
The main power consuming units are the multipliers, adders and the dividers. When 
these units are idle then power can be cut off to them. 

5.9.5 Miscellaneous Issues 

Fault tolerance issues have not been handled in this implementation. There must be 
some w’ay to warn the master processor in case the MiDiCal processor is performing 
faulty calculations. 

The processor, in its current implementation, runs to completion once it is reset. 
It must be modified so that the master processor can interrupt it at any time and 
then restart it from the point of interruption. 



Chapter 6 


Conclusions 


A massively parallel architecture for the implementation of HEBMT was proposed. 
Two main bottlenecks in the implementation of HEBMT were identified viz. 

• Dictionary searcli procedure. 

• Minimum distance calculation procedure. 

ASK! solutions wore proposed to overcome the two bottlenecks. The DiSe processor 
was modeled at the behavioral level. This processor was designed to solve the dictio- 
nary search problem. The MiDiCal processor was modeled at the behavioral level. 
'I'his processor was designed to solve the minimum distance calculation problem. 
I'he two behavioral models can serve as a base for more detailed(gate level, MOS 
level, etc.) design. Future directions were suggested for improving the performance 
of the two ASICs. 
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Appendix A 


DiSe Component Definitions 


The cliapter describes the components used in the structural modelling of the DiSe 
processor. All the components have been documented in VHDL. 


A.l Multiplexor 

entity mux is 
port ( 

10 : in bit_vector(7 downto 0); 

11 : in bit_vector(ll downto 0); 
y : out bit_vector(ll downto 0); 
select : in bit 

): 

end mux2; 

A. 2 Transparent Latch 

entity latch is 
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generic { 

width ; positive ; 

Tpd : Time := unit.delay ); 

port ( 

d : in bit_vector(width-l downto 0); 
q : out bit_vector(width-l downto 0); 
en : in bit 

); 

end latch; 

A. 3 Buffer 

entity buffer is 

generic ( 

'I'pd : Time unit-delay ); 

port ( 

a : in bit_8 ; 
b ; out bus-bit_8 bus; 
en: in bit ; 

); 

end buffer; 

A. 4 Program Counter 

entity PC is 

port { 

dJn ; in bit_12 ; 
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d_out: out bus_bit_12 bus ; 
clear : in bit ; 
latch _en : in bit ; 
out_en : in bit 

); 

end PC; 

A. 5 General Register File 

entity GEN .REG .FILE is 
port ( 

rp.l : out bus_bit.l2 bus ; 
rp.2 ; out bus_bit.l2 bus ; 
wp.gr: in bit.l2 ; 
rad.l: in bit_3 ; 
rad.2: in bit_3 ; 
a3 : in bit.3 ; 

<*iil,cn2,en3 : in bit 

); 

end GEN.REG_FILE ; 

A. 6 Source Register File 

entity SRC-REG.FILE is 
port ( 

RD : out bus.bit.S bus ; 
enl : in bit ; 
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WR : out bit.8 ; 
en2 : in bit ; 
next, init : in bit ; 
count_16 : in bit 

); 

end SRC.REG.FILE ; 

A. 7 Arithmetic Unit 

entity ALU is 
port ( 

op_l, op_2 : in bit_12 ; 

Result : out bus_bit.l2 bus ; 
coinniancl : in bit ; 
carry Jn.O : in bit ; 
enable : in bit 

); 

end ALU; 

A. 8 Comparator 

entity Comparator is 
l)ort ( 

op -2 : in bit.l2 ; 
enable : in bit ; 

EQ,LT ; out bit ; 

GT : out bit 



); 

end Comparator; 



Appendix B 


MiDiCal Component Definitions 


This appendix describes the interface definitions of some of the components used in 
the structural definition of the MiDiCal processor. 


B.l The ADU 


entity ADU is 
port ( 

result : out bit.vcctor(31 downto 0); 
done : out bit ; 

operand-l : in bit_vector(31 downto 0); 
operand_2 : in bit_vector(31 downto 0); 
command : in bit; 
go : in bit 

); 

end ADU; 
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B.2 The Multiplier 


entity MULTIPLIER is 
port ( 

result : out bit_vector(31 downto 0); 
done ; out bit ; 

operand.] : in bit_vector(31 downto 0); 
op<’rand_2 : in bit.vector(31 downto 0); 
command : in bit; 
go ; in bit 

); 

end MULTIPLIER; 

B.3 Floating-point Comparator Unit 

entity FLOAl'.COMPARE is 
port ( 

res : out bit_vector(31 downto 0); 
done : out bit ; 

op.l : in bit_vector(31 downto 0); 
opJ2 ; in bit_vector(31 downto 0); 
enable : in bit 

); 

endFLOAT.COM PA RE ; 

B,4 Integer Adder Unit 


entity INT.ADDER is 



sum : out bit_vector(31 downto 0); 
done : out bit ; 
c.out : out bit ; 

op_l : in bit_vector(31 downto 0); 
opJ2 : in bit_vector(31 downto 0); 
c.O : in bit ; 
command : in bit; 
go : in bit 

): 

end INT.ADDER; 

B.5 Noun-phrase Comparator Unit 

entity NP.COM PARATOR is 
port ( 

flags : out bit_vector(15 downto 0); 
op.l : in bit_vector(31 downto 0) ; 
op.2 : in bit_vector(31 downto 0) ; 
en : in bit 

); 

end NP.COM PARATOR; 

B.6 ASD Comparator Unit 


entity ASD.COM PARATOR is 



F_ASD_EQ : out bit_vector(3 downto 0); 
op_l : in bil-vector(31 downto 0) ; 
op_2 ; in bit_vector(31 downto 0) ; 
en ; in bit 

); 

end ASD.COMPARATOR; 

B.7 Register File: FP-1 

entity FP-1 is 

port ( 

rl : out bit.vector(31 downto 0) ; 
r2 : out bit.vector(31 downto 0) ; 
wl ; in bit_vcctor(31 downto 0) ; 
arl : in bit.vector(2 downto 0) ; 
ar2 ; in bit_vector(2 downto 0) ; 
awl : in bit_vector(2 downto 0) ; 
enrl : in bit ; 
enr2 : in bit ; 
enwl : in bit 

); 

end FP-1; 

B.8 Register File: FP-2 


entity FP-2 is 



92 


rl : out bit_vector(31 downto 0) ; 
r2 : out bit_vector(31 downto 0) ; 
wl ; in bit_vector(31 downto 0) ; 
arl : in bit_vector(2 downto 0) ; 
ar2 : in bit_vector(2 downto 0) ; 
awl : in bit_vector(2 downto 0) ; 
curl : in bit ; 
cnr2 : in bit ; 
cnwl : in bit 

); 

end FP-2; 

B.9 Register File: INT-REG 

entity INT-REG is 
port ( 

rl : out bit.vector(31 downto 0) ; 
r2 : out bit_vector(31 dow'nto 0) ; 
wl : in bit_vector(31 downto 0) ; 
arl : in bit. vector (3 downto 0) ; 
ar2 : in bit_vector(3 downto 0) ; 
awl : in bit_vector(3 downto 0) ; 
curl : in bit ; 
enr2 : in bit ; 
enwl : in bit 


); 

end INT-REG; 
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